Surgical Gesture Segmentation and Recognition
نویسندگان
چکیده
Automatic surgical gesture segmentation and recognition can provide useful feedback for surgical training in robotic surgery. Most prior work in this field relies on the robot's kinematic data. Although recent work [1,2] shows that the robot's video data can be equally effective for surgical gesture recognition, the segmentation of the video into gestures is assumed to be known. In this paper, we propose a framework for joint segmentation and recognition of surgical gestures from kinematic and video data. Unlike prior work that relies on either frame-level kinematic cues, or segment-level kinematic or video cues, our approach exploits both cues by using a combined Markov/semi-Markov conditional random field (MsM-CRF) model. Our experiments show that the proposed model improves over a Markov or semi-Markov CRF when using video data alone, gives results that are comparable to state-of-the-art methods on kinematic data alone, and improves over state-of-the-art methods when combining kinematic and video data.
منابع مشابه
Accelerometer Based Real-Time Gesture Recognition
Gesture is a natural expression form for humans, but its recognition is a similarly hard problem as speech recognition. In this paper, I present a real-time hand gesture recognition system, which identifies relevant parts in the continous sensor data stream, and classifies them to the most probable gesture. Instead of the usual button-based segmentation, I have created an automatic segmentation...
متن کاملGesture Segmentation Using an Adaptive Threshold Algorithm
Hand gesture segmentation is a key step for gesture recognition. Based on the construction of a new color space of skin model, a new dynamic-thresholding segmentation approach named Adaptive Threshold Segmentation Algorithm (ATSA) was further developed and segmentation effect evaluation was conducted. Some images of hand gesture were processed by using ATSA and the Fixed Threshold Segmentation ...
متن کاملLarge-scale Continuous Gesture Recognition Using Convolutional Neutral Networks
• General method description:This paper addresses the problem of continuous gesture recognition with convolutional neutral networks (ConvNets) using depth maps sequences. Unlike the common isolated recognition scenario, the gesture boundaries are here unknown, and one has to solve two problems: segmentation and recognition. For segmentation, we first obtained the begin and end frames of each ge...
متن کاملFace Recognition Using YCbCr and CIElab Skin Color Segmentation Methods:A Review
Skin Color segmentation plays an important role in various applications such as face recognition, gesture recognition, human computer interaction etc. Face recognition is of main concern in skin color segmentation. There are various color models used for skin color segmentation (YCbCr, HSV and CIELAB) but appropriate method should be used for skin color segmentation. In real time the main probl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Medical image computing and computer-assisted intervention : MICCAI ... International Conference on Medical Image Computing and Computer-Assisted Intervention
دوره 16 Pt 3 شماره
صفحات -
تاریخ انتشار 2013